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Abstract 

In this paper we consider the nonparametric functional estimation of the 
drift of Gaussian processes using Paley- Wiener and Karhunen-Loeve expansions. 
We construct efficient estimators for the drift of such processes, and prove their 
minimaxity using Bayes estimators. We also construct super efficient estimators 
of Stein type for such drifts using the Malliavin integration by parts formula and 
stochastic analysis on Gaussian space, in which superharmonic functionals of the 
process paths play a particular role. Our results are illustrated by numerical 
simulations and extend the construction of James-Stein type estimators for 
Gaussian processes by Berger and Wolpert [2]. 
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1 Introduction 

The maximum likelihood estimator fi of the mean /i G M'' of a Gaussian random vector 
X in R'^ with covariance a l^d under a probability is well-known to be equal to X 
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itself, and can be computed by maximizing the likelihood ratio 

1 _J£-m||^ 

— e 

with respect to m, where || ■ ||d denotes the Euclidean norm on W^. It is efficient in 
the sense that it attains the Cramer-Rao bound 

a'd = E^[||X - = inf E^[||Z - /i G 

over all unbiased estimators Z satisfying 1E^[Z] = /x, for all /x G W^. 

In [H], James and Stein have constructed superefficient estimators for the mean of 
X G M'^, of the form 

whose risk is lower than the Cramer Rao bound a'^d in dimension (i > 3. 

Drift estimation for Gaussian processes is of interest in several fields of application. 
For example in the decomposition 

Xt = Xlt + Uu tG[0,T], 

the process {Xt)te[f),T] is interpreted as an observed output signal, the drift {ut)te[Q,T\ 
is viewed as an input signal to be estimated and perturbed by a centered Gaussian 
noise (X")te[o,T]5 cf. e.g. |j8j, Ch. VII. Such results find applications in e.g. telecom- 
munication (additive Gaussian channels) and finance (identification of market trends). 

Berger and Wolpert [2], [17], have constructed estimators of James-Stein type for the 
drift of a Gaussian process {Xt)te[o,T] by applying the James-Stein procedure to the 
independent Gaussian random variables appearing in the Karhunen-Loeve expansion 
of the process. In this context, u := {Xt)t(^Rj^ is seen as a minimax estimator of its 
own drift {ut)t(iM.+ - 

Stein [15] has shown that the James-Stein estimators on could be extended to a 
wider family of estimators, using integration by parts for Gaussian measures. Let us 
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briefly recall Stein's argument, which relies on integration by parts with respect to the 
Gaussian density and on the properties of superharmonic functionals for the Laplacian 
on M'^. Given an estimator of ;U G M'* of the form X + g{X), where ^ : M'^ ^ M"^ is 
sufficiently smooth, and applying the integration by parts formula 

]E,[{X, - fi^X)] = a'-E^[dMX)], (1.1) 

g = a^gradlog/ = a^{di log/, . . . , ddlogf), one obtains 

d 

E^[||X + a' grad log /(X) - = aH + Aa' ^ 

1=1 

i.e. X + 0"^ grad log /(X) is a superefficient estimator if 

d 

^iVJi^) < 0; dx — a.e., 

i=l 

which is possible if d > 3. In this case, X + cr^ grad log /(X) improves in the mean 
square sense over the efficient estimator u which attains the Cramer-Rao bound a'^d 
on unbiased estimators of /i. 

In this paper we present an extension of Stein's argument to an infinite-dimensional 
setting using the Malliavin integration by parts formula, with application to the con- 
struction of Stein type estimators for the drift of a Gaussian process {Xt)teio,T]- Our 
approach applies to Gaussian processes such as Volterra processes and fractional Brow- 
nian motions. It also extends the results of Berger and Wolpert [2J in the same way 
that the construction of Stein [15] extends that of James and Stein [9] , and this allows 
us to recover the estimators of James-Stein type introduced by Berger and Wolpert [2] 
as particular cases. Here we replace the Stein equation (11.11) with the integration by 
parts formula of the Malliavin calculus on Gaussian space. Our estimators are given 
by processes of the form 

X^ + AlogF, te[0,T], 

where F is a positive superharmonic random variable on Gaussian space and Dt is the 
Malliavin derivative indexed by t G [0,T]. In contrast to the minimax estimator u, 
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such estimators are not only biased but also anticipating with respect to the Brownian 
filtration {J-'t)te[o,T]- This however poses no problem when one has access to complete 
paths from time to T. 



For large values of cr it can be shown that the percentage gain of this estimator is at 
least equal to the universal constant 



which approximately represents 11.38%, see (17.41) below. 

We proceed as follows. In Section [2] we use stochastic calculus in the independent 
increment case to derive a Cramer-Rao bound over all unbiased drift estimators. This 
bound is attained by the process u := {Xt)te[o,T], which will be considered as an effi- 
cient drift estimator. In Section [3] we compute the Bayes estimators obtained under 
prior Gaussian distributions. We show that these Bayes estimators are admissible, 
and use them to prove that the drift estimator ii is minimax. The tools and results 
presented in Sections |2] and [3] are not surprising, but we did not find any source 
covering them in the literature. In Section H] we recall the elements of analysis and 
integration by parts on Gaussian space which will be needed in Section [5] to construct 
superefficient drift estimators for Gaussian processes using superharmonic random 
functionals on Gaussian space. The superefficiency of these estimators will show, as 
in the classical case, that the minimax estimator u is not admissible. In Section [6] we 
give examples of nonnegative superharmonic functionals using cylindrical functionals 
and potential theory on Gaussian space. Examples are considered in Section [7] in case 
u is deterministic. We show that the James-Stein estimators of Berger and Wolpert 
[2] can be recovered as particular cases in our approach, and we provide numerical 
simulations for the gain of such estimators. It turns out that in those examples, the 
gain obtained in comparison with the minimax estimator (Xt)tg[o,T] is a function of 
cr^/T, thus making a and T play inverse roles, unlike in the usual setting of Brownian 
rescaling. 
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This paper is an extended version of P2J and provides proofs of the results presented 
in [13]. 

Notation 

Let T > 0. Consider a real-valued centered Gaussian process {Xt)te[o,T] with covari- 
ance function 

'j{s,t) = E[XsXt], s,te[0,T], 

on a probability space (^2, JF, P), where JF is the a-algebra generated by X. Recall 
that {Xt)te[o,T] can be represented in different ways as an isonormal Gaussian process 
on a real separable Hilbert space H, i.e. as an isometry X : H L'^{Q, J-", P) such 
that {X{h) : h G H} is a family of centered Gaussian random variables satisfying 

nXih)X{g)] = {h,g)H, h,geH, 
where (■, ■)h and || • \\h denote the scalar product and norm on H. 

One can distinguish two main types of such isonormal representations of Xf, see e.g. 
[1] and [2] respectively for details. 

(A) Paley- Wiener expansions. In this case, H is the completion of the linear space 
generated by the functions Xt{s) = min(s,t), s,t E [0,T], with respect to the 
norm 

{Xt,Xs)H ■.= i{s,t), s,te[0,T], 
and X{-) is constructed on H from X{Xt) '■= Xt, t G [0,T], i.e. we have 

oo 

Xi-Xt) = Y,{^t,h{t))HX{hk), t G [0,T], 

fc=0 

for any orthonormal basis (/ifc)fc6N of H. Assume in addition 7(5, t) has the form 

psAt 

7(s,t)= / K{t,r)Kis,r)dr, s,te{0,T], 
Jo 

where K{-, ■) is a deterministic kernel and 

{Kh){t) := [ K{t,s)h{s)ds 
Jo 
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is differentiable in t G [0, T], and let K* denote the adjoint of K with respect to 

{h,g) := (/i,5')L2([o,T],di)- 
The scalar product in H then satisfies 

{h,g)H = {K*h,K*g) = {h,Tg), 
where F = KK*, and we have the decomposition 

oo oo oo 

= ^{Xt,hk)HX{hk) = '^{l[o,t],'^hk)Lmo,T],dt)Xihk) = ^Thk{t)X{hk), 

k=0 k=0 k=0 

t G [0,T]. In this case we also have the representation 

Xt= [ K{t,s)dWs, te[0,T], 
Jo 

where {Ws)si^io,t] is a standard Brownian motion, cf. pQ. 

(B) Karhunen-Loeve expansions. This framework is used in [2]. In this case, /i is a 
finite Borel measure on [0, T] and H is defined from 



where 



and 



with 



{h,g)H = {h,Tg), 



{h,g) ■= {h,g)L2([o,T],dfj,), 



[ g{sHs,t)fi{ds), te[0,T], 
Jo 



X{h) = [ Xsh{s)fi{ds), heH. 
Jo 

Given {hk)km an orthonormal basis of L^([0, T], ci/i), we have the expansion 

oo 

Xt = J2hk{t)x{h), te[0,T]. 

k=0 
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In the sequel we will use mainly the framework (A) with {h,g) = (/i, 5')L2([o,r],(it)) 
which is better adapted to our approach, although some results valid in the general 
framework of Gaussian processes will be valid for (B) as well. 



The Girsanov theorem for Gaussian processes, cf. e.g. [TT], states that X" defined as 

X^ig) := Xig) - {g, u) = X{g) - {g, T-'u)h, 9 E H, 
where m G if is deterministic, has same law as X under the probability P„ defined by 

^ = exp(^X(r u)--\\T uUj. 
In other terms, in case {A) we have 

Xt-uit) = Xt~TT-\{t) 

oo 

= Y.^hk{t){X{hk)-{hk,T-\)H) 

k=0 

oo 

= Y,^h,{t)x\h), te[o,T], 

k=0 

where {hk)km is orthonormal basis of H, and in case {B), 

oo 

Xt-u{t) = '^hk{t){X{hk) - {hk,u)L2([o,T],di^)) 

k=0 

oo 

fe=0 
oo 

= J]/ifc(t)x^(/ifc), te [o,T], 

k=0 

where {hk)km is orthonormal basis of L^{[0,T],dfi). 

2 Efficient drift estimator 

Here we work in the framework of (A), in the particular case where (Xt)fg[o,T] has 
independent increments, i.e. 

psAt 

7(s,t) = / aldu, 
Jo 
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where cr e L'^{[0,T],dt) is an a.e. non- vanishing function, 

{kh){t) = {k*h){t) = ath{t), t e [o,r], 

with K{t,r) — l[o,t](r)(7r and 

rh{t) = [ hsulds, t e [o,r]. 

Jo 

In other terms, {Xt)t,=[o,T] is a continuous Gaussian martingale with quadratic variation 
a^dt, which can be represented as the time change 

= te[0,T], 

of the standard Brownian motion {Wt)teM.+ , or as the stochastic integral process Xt — 

[ 0-3(^1^5, i e [0,r], and we have = ( h{s)dXs, h e H , where 
Jo Jo 

H = !^v:[0,T]^R : v{t) = v{s)ds, t e [0,T], v e L'^{[0,T],atdt)'^ 

is the Cameron-Martin space with inner product 

{vi,V2)h^ I vi{s)v2{s)alds, vi,V2 e H. 



JO 

Let {J-'t)t£[o,T] denote the filtration generated by {Xt)t£[o,T], and for u an J^(-adapted 
process, let denote the translation of the Wiener measure on fl by u, i.e. is the 
measure on Q under which 

X^:^Xt-Ut, te[0,T], 
is a continuous Gaussian martingale with quadratic variation 

d{X'',X'')t = a^dt. 
Consider u an J^^-adapted processes of the form 

lit = / iigds, t e [o,r], 

Jo 



with 



T • 2 

%ds 
cr' . 
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< 00. 



By the Girsanov theorem, is absolutely continuous with respect to P'^, with 
where 

Us 1 / ui 



A(u) exp / -|rfX. - - / -fci. 

V^O ^ Jo 

denotes the Girsanov-Cameron-Martin density, the canonical process {Xt)t(^[o^T] be- 
comes a continuous Gaussian semimartingale under P^, with quadratic variation a^dt 
and drift iitdt. The expectation under P„ will be denoted by E^. 

Definition 2.1. A drift estimator^ is called unbiased if 

Eu[Ct]^'Eu[ut], te[0,T], 

for all square-integrable J^t-o-dapted process {ut)te[Q,T] ■ is called adapted if the process 
(6)te[o,T] is J^t-o-dapted. 

Here, the canonical process (Xt)tg[o,T] will be considered as an unbiased estimator of 
own its drift {ut)te[o,T] under P^, with risk defined as 



\^ - «llL2([0,T],d/x) 



f l^idt) = [ [ aldsi,{dt), 

Jo Jo 



where is a finite Borel measure on [0, T] . Clearly this estimator is consistent as a 
or T tend to 0: precisely, given N independent samples 

{Xl)te[o,T], ■ ■ ■ , (^t^)te[o,r], 

of {Xt)te[o,T\, the process 



N 



Xt-.^ ' * , te[o,T], (2.1) 



is an unbiased estimator of {ut)te[o,T] whose risk 



X - 'tJ'Wlmondu) 



converges to zero as N goes to infinity. 



1 '■^ 



N 



JO 



agds^{dt) 
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The justification of tlie use of -u = (Xj)ig[o,T] as an efficient estimator comes from 
tlie following proposition wliicli allows us to compute a Cramer-Rao bound attained 
by u. Here the parameter space is restricted to the space of adapted processes in 
L^(Q X [0, TjjP® //), which corresponds in a sense to a parametric estimation. 

Proposition 2.2. Cramer-Rao inequality. For any unbiased and adapted estimator 
^ of u we have 



> R((7, 



(2.2) 



where u e L'^{Vt x [0,T],P^ ® /i) is adapted and the Cramer-Rao type bound 

R((T, pL, u) :— / a1dsii{dt) 
Jo Jo 

is independent of u and attained by the efficient estimator u — X. 
Proof. Since ^ is unbiased, for all C ^ -f^ we have 



hence 



d 

de 

^]E-[(6-Mi)A(M + £C)]|e=o 



{^t-Ut)^f^{u + eC)\e=o 
(6 ~ ^ ^(^ + ^0 k=o 



i^t-ut) ( / ^dXs 



Jo (^s 
Jo '^s 



ds 
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where the exchange between expectation and derivative is justified by classical uniform 
integrability arguments. Thus, by the Cauchy-Schwarz inequality and the Ito isometry 
we have 

ES[l6-w*r]= r ^dslE:[\^t-Ut\% te[0,T]. 

Jo 







It then suffices to take 



to get 



Ct= I (ylds, te [o,T], 

^0 



Var^[6] = E^[|6-«tr]> / aids, tG[0,T], (2.3) 

which leads to (12. 2p after integration with respect to fi{dt). As noted above, u = 
(Xt)tg[o,T] is clearly unbiased under and it attains the lower bound R((T, □ 



Recall that the classical linear parametric estimation problem for the drift of a diffu- 
sion consists in estimating the coefficient 6 appearing in 

d^t = Oat{^t)dt + dYt, ^0 = 0, 

with a maximum likelihood estimator 6t given by 

Or = IL^^, (2.4) 
loamdt 

cf. [To], [H] for Brownian motion and [T6j for an extension to fractional Brownian 
motions. 



Here we consider the nonparametric functional estimation of the drift of a one- 
dimensional drifted Brownian motion {Xt)tm+ with decomposition 

dXt = Utdt + dX^, (2.5) 

where {ut)te[o,T] ^ L'^{^ x [0,T]) is an adapted process and (X")tgK^ is a standard 
Brownian motion with quadratic variation under a probability P^. 
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In case u is constrained to have the form Ut = 6t, t & [O^^]; 6' G M, our efficient esti- 
mator u satisfies ut = OtT, where 6t is given by (12 ■4p . T > 0, with the asymptotics 
9t ^ in probabihty as T tends to infinity. The asymptotics is not in large time 
since T can be a fixed parameter, but the efficient estimator u = X converges to u as 
a tends to 0, or equivalently as T tends to by rescahng. 

To close this section we note that, at least informally, u = {Xt)te[o,T] can be viewed as 
a maximum likelihood estimator of its own adapted drift {ut)te[o,T] under P^. Indeed 
the functional differentiation of the Cameron-Martin density 

^A(u + £C)|e=o = 0, C^H, 



implies 



which leads to X = -u. 



^dx, - [ ^du, = 0, C e i/, 

Jo (^s 



3 Bayes estimators 

In this section we consider Bayes estimators which will be useful in proving the min- 
imaxity of the estimator -u = X in the framework of (A) for Gaussian processes with 
non-necessarily independent increments. We will make use of the next lemma which 
is classical in the framework of Gaussian filtering and is proved in the Appendix. 

Lemma 3.1. Let Z be a Gaussian process with covariance operator Tr and drift 
V E H , and assume that X is a Gaussian process with drift Z and covariance operator 
r given Z . Then, conditionally to X , Z has drift 

f ^ {f,{V + V,)-^Vv) + X{{T + VrY^Vrf) and covariance Vr{T + V,)-^V. 



Note that unlike in Proposition 12. 2[ no adaptedness or unbiasedness restriction is 
made on ^ in the infimum taken in (13. 2p below. 
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Proposition 3.2. Bayes estimator. Let denote the Gaussian distribution on Vt 
with covariance operator Tr and drift v E H . The Bayes risk 

-T 



\it - zt\ n{dt) 



dFliz) 



(3.1) 



of any estimator {C,t)te[o,T] on Q under the prior distribution is uniquely minimized 



by 



^l'" := (Xt, (r. + T)-'Tv) + X((r. + T)-'Tr Xt), te [0, T] 



[z . 



(3.2) 



which has risk 

[ {Xt, r(r. + T)-'Tr Xt)ix{dt) = inf / E J / |6 - zt\'fx{dt) 
Jo 5 Jq iJo 

Proof. Let Z denote a Gaussian process with drift v & H and covariance F^. Recall 
(cf. Lemma 13.11) that if X has drift Z and covariance F then, conditionally to X, 

{Zt)te%T] has drift 

t ^ {Xu {Tr + Vy^Tv) + X((F. + Vy^T, Xt) 

and covariance F^(F,- + F)^^F. Hence the Bayes risk of an estimator ^ under the prior 
distribution is given by 



E, 



l^t - zt\^^i{dt) 



dWJz) = E 



E 



\^t-Zt\'^i{dt) 



E 
E 



T 



\^t-nzt\x]\^fx{dt) 



+ E 



L^O 

T 



X 



Vai{Zt\X)fx{dt) 



IJO 



/ |6 - {Xt, (F. + ry'Tv) - X((F, + F)-^F. Xt)\'fi{dt) 
Jo 



T 



+ / {Xt,TiVr + Ty'VrXt)li{dt), 
'o 



which is minimized by 

:= E[Zi I X] = {Xt, {Tr + ry'Tv) - X((F. + Vy'T^ Xt), t e [0,T]. 



□ 



13 



Clearly ^'^'^ is unique in the sense that it is the only estimator to minimize the Bayes 
risk (13. ip . This shows in particular that every is admissible in the sense that if 
an estimator ^ satisfies 



then 



hence 



< E, 



11^.,. _ ^1,2 



L2{[0,T],dti) 



E, 



L'2{[0,T],dfi) 



([0,T],dM) 



E. 



L2{[0,T],dfi) 



[ {Xt,TiT^ + T)-'TrXt)^idt), 
Jo 

(Xt,r(r, + r)-ir, Xt)fi{dt), 



and ^ = by Proposition 13.21 



(3.3) 



The Bayes estimator ^^'"^ is biased in general, and for deterministic u & H its mean 
square error under P„ is equal to 



E„ 



f \ir-ut?Kdt) 

Jo 



(3.4) 



E 
E 



+ E„ 



x"((r. + r)-ir, Xt) 'f^{dt) 
r ((r. + T)-'T, Xt, r(r. + n-^r, Xt)fi{dt) 

Jo 

{XuCrr + ry'Tiv-u)) \idt), 



T 

I iE„[en-«trMc^t) 

Jo 



{Xt,{T, + V)-^V{y-u)) fi{dt) 



+ 



which shows that 



sup E„ 

u(^H IJo 

hence C,'^'^ is not minimax. 



Jo 



+ 00, 



In the independent increment case of Section[2]we have, if r^/(s) = /(s), s G [0, T]: 



' ' ds+ I -^^^dX,, te[0,T], 



r2 + (t2 
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with risk 



^0 



r2 + (t2 



dsfi{dt) = inf / E 



(3.5) 



Assuming now that TT-f{t) = r'^fit), t G [0,T], the Bayes risk 

r{Xt, TriT, + T)-'T Xt)Kdt) = r {Xu (/ + r/r2)-ir Xt)^{dt), 
Jo Jo 

of r G M, converges as r ^ oo to the bound 



R(cr, /i, m) 



(Xt,rXt)/i(rft), 



hence it follows in the next proposition that, as in the finite dimensional Gaussian case, 
the estimator u = {Xt)te[o,T] is minimax. Note again that unlike in Proposition \2.2\ 
no adaptedness condition is imposed on C, in the infima fl3.2p and (13. 6p . 



Proposition 3.3. The estimator u = X is minimax. For all u & Q we have 



/ \Xt - utl"^ ij{dt) 
Jo 



R(7,/i,M) = E„ 
Proof. Clearly, taking ^ = yields 



inf sup Ei, 



16 - Vtl'^Kdt) 



(3.6) 



R(7, /i, u) = sup Eu 

ueQ \_Jo 



/ \Xt - Ut\^iJ,{dt) 
Jo 



> inf sup Eu 
5 ueQ ["'o 



Jo 



On the other hand, from Proposition 13.21 for all processes ^ we have 
supE„ [ / let - utl^fxidt)] > / E J / 16 - 

neO \_Jo J L"'0 

> / (Xt,(/ + r/r2)-irxt)/i(dt), 

Jo 

for all r > 0, hence 



inf sup Eu 



16 - ut\^fi{dt) 



> / (Xt, r Xt)/i(rft) = R(7,/i,u). 

^0 



□ 



15 



4 Malliavin calculus on Gaussian space 

Before proceeding to the construction of Stein type estimators, we need to introduce 
some elements of analysis on Gaussian space, see e.g. [TI]. This construction is valid 
in both frameworks (A) and (B). Given u & H, let 

X" = X - M. 

We fix {K) „>i a total subset of H and let S denote the space of cylindrical functionals 
of the form 

F = fr.{X^{h),...,X^{h^)), (4.1) 

where is in the space of infinitely differentiable rapidly decreasing functions on M", 
n > 1. 

Definition 4.1. The H -valued Malliavin derivative is defined as 

n 
i=l 

for F eS of the form fliTT]) . 



It is known that V is closable, cf. Proposition 1.2.1 of [TTj, and its closed domain will 
be denoted by Dom (V). 

Definition 4.2. Let D be defined on Dom (V) as 

DtF := {TVF){t), te[0,T], FeDom(V). 

Let S : Ll^{fl; H) — > L'^{Q,Fu) denote the closable adjoint of V, i.e. the divergence 
operator under F^, which satisfies the integration by parts formula 

]E4F6iv)]=]E4{v,VF)H], FGDom(V), vGDom(5), (4.2) 

with the relation 

S{hF)=FX{h)-{h,VF)H, 

cf. [m, for F G Dom (V) and h E H such that HF G Dom (5). Note that (iSI) is 
an infinite-dimensional version of the integration by parts ( 11. ip . which can be proved 
e.g. using the countable Gaussian random variables constructed from X. 
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Lemma 4.3. We have 



Eu[FX^] = lEu[DtF], te[Q,T], Fe Dom (V). 

Proof. 

(A) In the case of Paley- Wiener expansions we have 

E„[FX«] = ]E„[FX"(X,)] 

= lE4F6{Xt)] 

= Eu[{Xt,VF)H] 

= Eu[(l[o,t],rVF)i,2([o,r],<it)] 

= ]E„[(rVF)(i)], FeDom(V), te[0,T]. 

(B) In the case of Karhunen-Loeve expansions we have 

oo 

E^FX^] = J]/i,(t)E„[FX«(/ife)] 

k=0 

oo 

= Y,hk{t)Eu[F6{hk)] 

k=0 

oo 

fe=0 

oo 

= ^/ife(t)Eu[(/ife,rVF)i2([o,T],^)] 

fc=0 

= E„[(rVF)(i)], FeDom(V), te[0,T]. 

□ 

Definition 4.4. l¥e define the Laplacian A 6?/ 

AF = traceL2([o,r],(iM)®2-Di:>F = / DtDtF ^{dt) 

Jo 

on the space Dom (A) made of all F e Dom (V) such that DfF e Dom (V), t e [0, T], 
and {DtDtF)teio,T\ e L\[0,T],fi), F-a.s. 
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If -F G 5 has the form (14. ip we have 



Unhke the Gross Laplacian defined by 

AgF = trace j^®2VVF, 
the operator A is closable, as shown in the following proposition. 

Proposition 4.5. Closability of A. For any sequence (-F„)„gN of random variables 
converging to in L^(fi,P„) and such that (AF„)„gf^ converges in L'^{Q,Fu), we have 

lim AF„ = 0. 

n—*oo 

Proof. Let (G„)„gN a sequence in S converging to in L'^{Q,Fu), and such that 
{AGn)nef>i converges to F in L^(f2, P^). For all G G 5 we have, in the notation of (A): 

\{AGn,G)LHn,Fj = E Jg / DtDtGn^dt) 

L Jo 

E4(VAG„,Xt G)H]f^{dt) 
lE^[DtG^S{Xt G)]fxidt) 
E„[(VG„,Xt5(Xt G))H]^i{dt) 
Eu[Gn5{Xt 5{Xt G))]fiidt) 



< \\Gn\\mn,F^) / \\6{Xt5{XtG))\\mn,F^)fi{dt), 
Jo 

hence {F, G) 

L'^{n,Vu) — ^} G E S, which implies F = 0. □ 
We will say that a random variable F in Dom (A) is A-superharmonic on Q if 



AF{uj) < 0, P(dcj) - a.s. 



(4.3) 
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Remark 4.6. In the independent increment case where 7(5, t) is given by 

rsAt 

j{s,t)= / aldt, s,te[0,T], 
Jo 



we have 



6{v) 



VtdX^ 



t ' 



(4.4) 



for every Tt-adapted process v e L^(fi; H, P„). 

5 Superefficient drift estimators 

Our aim is to construct a superefficient estimator of u of the form X + whose mean 
square error is strictly smaller than the minimax risk R(7, /i, u) of Proposition 13.31 
when ^ G -^^^([0, T] x 1], P^j (g) /i) is a suitably chosen stochastic process. This estimator 
will be biased and anticipating with respect to the Brownian filtration. In the next 
lemma we follow Stein's argument which uses integration by parts but we replace 
(11. ip by the duality relation (14. 2 p between the gradient and divergence operators on 
Gaussian space. The results of this section are valid in both frameworks {A) and {B). 

Lemma 5.1. Unbiased risk estimate. For any i G L'^iVl X [0,r],P„ ® /i) such that 
it G Dom(V), t G [0,r], and {Dtit)te%T] e L\n x [0, T], P„ ® /x), we have 



L2([0,T],m) 



R(7,/i,M) + U\\l2^ux[0,T]Mt,) + '^^u 



(5.1) 



Proof. We have 



1^ + ^ ~ '"■\\L^{[0,T],dfj.) 



E„ 



fi{dt) 



E,, 



T 



X^\'fi{dt) 



Uo 



+ ll^llL2(nx[0,T],P„(g)At) +2E„ 



xriMdt) 



Uo 



= R(7,/i,M) + U\\h(nx[o,T],Vum) +2E„ 
and apply Lemma H73] to obtain (15. ip . 



xriMdt) 



□ 
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The next proposition specializes the above lemma to processes ^ of the form 

6 = AlogF, t e [0,T], 

where F is an a.s. strictly positive and sufficiently smooth random variable. 

Proposition 5.2. Logarithmic gradient. Stein-type estimator. For any P-a.s. pos- 
itive random variable F G Dom (V) such that DtF G Dom (V), t G [0,T], and 
{DtDtF)t^[o^T] e L\Q X [0,T],P„®/i), we have 



\X + DlogF - u\\l2(^[o^T],df^) 



R(7,/i,M)-E„ llDlogFlli^ 



([0,T],m) 





'AF' 








F 



Proof. From (15.11) we have 
E„ \\X + DlogF ~u\\l2^[o^T],^,) 



R(7,/i,M) + \\DlogF\\l2^^^[o^T]M^^)+'^^u 



AAlogF/i(rft) 



L^o 



R(7,/i,M) + E„ 



and we use the relation 





DtF 


[f( 


F 



2AAlogF /i(rft) 



DtF 



+ 2AAlogF = 2 



DtDtF 



DtF 



te[o,T]. 



□ 



From the above proposition it suffices that F be A-superharmonic for X + D log F to 
be superefficient. In this case we have 



E. 



|X + DlogF-u"2 



L'mo,T],dti) 



< R(7,/i,M) 



E, 



|-DlogF||^2([o,T],d/x) 



(5.2) 



with equality in (15.21) when F is A-harmonic. 



In the next proposition we show that the A-superharmonicity of F is not necessary 
for X + DlogF to be superefficient, namely the A-superharmonicity of F can be 
replaced by the A-superharmonicity of ^/F, which is a weaker assumption, see [5] in 
the finite dimensional case. In particular, X + D logF is a superefficient estimator of 
u if A^/F < on a set of strictly positive P-measure. 
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Proposition 5.3. Stein-type estimator. For any ¥-a.s. positive random variable 
F e Dom(V) such that DtF G Dom (V), t G [0,T], and {DtDtF)t^[o^T] e L\n x 
[0, T] , P„ ® /i) , we have 



\X + DlogF -u\ 



L2([0,T],d/x) 



R(7,/i,M) +4E„ 



(5.3) 



Proof. For any F G Dom ( V) such that F > 0, P-a.s., and vF G Dom (A), we have 



D,F 



2 ^JD^F 



F 

which imphes 



and allows us to conclude from Lemma 15.11 



f DfF\ 4 r- 



a/f af 

4.—^ = 2— 



\Dt\ogF\^fx{dt), 



(5.4) 

□ 



Relation (15.31) extends to any F G Dom (V) such that vF G Dom (A), and F > 0, 
Av^F < 0, P-a.s. 



In case {Xt)t£[o,T] is a Brownian motion with constant variance at = cr, t E [0,T], we 
have 



|X + F)logF-u||i2 



{[0,T]) 



< — ^ + 4E„ 



AVF 



(5.5) 



Given (X^°^'^)tg[o,T], • • • , {^t'^)te[o,T] are iV independent samples of {Xt)t(^[o,T], the pro- 
cess X defined in (12.11) satisfies 



|X + F)logF-u||^2 



([0,T]) 



1 4 
-R(a,/i,M) + — E„ 



AVF 



As in [15], the superefficient estimators constructed in this way are minimax in the 
sense that from Proposition 13.31 and Proposition 15. 2[ for all m G -ff we have 



E,, 



|X + F)logF-M||^2 



([0,T],m) 



< R(7, /U, ii) = inf sup E„ 



16 - vtl^dt 



provided Ay F < on a set of strictly positive P-measure, thus showing that the 
minimax estimator u = (Xj)tg[o,T] is inadmissible. 
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Both estimators Xf + Dt log F and Xf + JE^lDt log F \ J^t] have bias 

bt = Eu[Xt + Dt\ogF -ut] = E4DtlogF], te [0,T], 



which can be bounded as follows from (15.41) : 



lL2{[o,r],/.) 



'0 

< 1E„ 



E„[AlogF]|2rft 

T 



2E„ 





a/f 









Remark 5.4. In the independent increment case of Section\^ the formulas obtained 
in this section also hold for u an adapted process in L'^{Q x [0,T]). However, in this 
case the computation of the gradient D log F requires in principle the knowledge ofX^, 
except when u is deterministic, in which case the knowledge of X is sufficient. Thus, 
assuming u to he deterministic will he necessary for the applications of Section 

6 Superharmonic functionals 

In this section we give examples of nonnegative superharmonic functionals with re- 
spect to the Laplacian A. We start by reviewing the construction of such functionals 
using potential theory on the Gaussian space P), and next we turn to cylin- 

drical functionals which will be used in the numerical applications of Section [71 We 
assume that {Thk)k>i is orthogonal in L^([0, T], ci/i), and we let 

Afe = ||r/ijt||j;^2([o,T],/i), A; > 1. 

The sequence {hk)k>i can be realized as the solution of the eigenvalue problem 

Thk = -XXhk. hk{T)=0, k>l, (6.1) 

in case (A), provided fi{dt) = dt, and 

Thk = Xlhk, k>l, 

in case (B) for general /i. 
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Potentials 



We refer to [7] and [6] for the notion of harmonicity on tlie Wiener space with respect to 
the Gross Laplacian. From our orthonormahty assumption on {hk)k>i, the Laplacian 
A is written as 

AF = ^ d^U h{s)dX^, K{s)dX: 

on cyhndrical functionals. Let {W^)t>o denote the standard fi-valued Wiener process 
with generator on (^7-^)1?); represented as 

< = E / hn{s)alds^^, t e R+, (6.2) 

where (/3n(^))teM+; > 1; are independent standard Brownian motions on (fi,jF, P), 
given as 

Pn{t)= [ ^^dWpir), tGR+, n>l. 

Jo W'T'nWH 



We have the covariance relation 



Vi{r)dW'/{r) / V2{r)dWl\r) 
Uo Jo 



E 

In other terms we have 



[S At){vi,V2)H, S,teR+, Vi,V2eH. 



~ r o, X , X fn hnis)(T'^ds L hn(s)a^ds 



n=l 



(s A 



I h • °° h ■ 

^) ( 5Z II/, p / 'hn{s)alds, ^ II , / hn{s)alds 
\n=i W^^Wh Jo „=i ll'^nll// ^0 , 



L^{[0,T],(7fdt) 



{S A t)(l[o,a], l[0,b])L2([0,T],<72dt) 

(s A t) / a^dr, 0<a,b<T, s,t e 



which shows that (}V[^{a))aeio,T] is a continuous Gaussian martingale with quadratic 
variation a^da for fixed t G IR+. 



Denote by (-Bt)teR+ the iJ-valued Wiener process represented as 

oo , 

n=o ll'^"!!^^ 
23 



with Pn{t) = {Bt, hn)H, n> 1, and covariance 

t:[{Bs,hn)H{Buhm)H] = l{„=m}(s At), s,t G M+, 

i.e. 

where Q : H H is the operator with eigenvalues {||/in||iif^ : n > 1} in the Hilbert 
basis {hn)n>i- Ito's formula for Hilbert-valued Wiener processes, cf. Theorem 4.17 of 
[5, shows that 

F{Bt) = F{Bo) + / {DF{B,), dBs)H + \ ! AF{Bs)ds, F e S, 
Jo ^ Jo 

hence {Bt)teR+ has generator ^A. 

Dynkin's formula, cf. [1], Theorem 5.1, shows that for all stopping time r such that 
lE[r \ Bq = uj] < oo we have, F'^{duj)-a.s.: 



nF{Br) \Bo = io]~ F{u) = 



AF{Bs)ds \Bo = u 







hence AF < implies 

F{iu) > t:[F{Br) I Bo = iu]. 

For r > 0, let 

Tr = mi{t e R+ : Bt ^ 25^ (Sq)} 

denotes the first exit time of (-Bj^gp^T] from the open ball ^r{^^) of radius r > 0, 
centered at Bq = uj E Q. We have the following converse. 

Proposition 6.1. Let F G Dom(A) be such that AF is continuous on Q, and assume 
that there exists tq > such that 

F{Lu)>t:[F{Br,)\ Bo = iu], Fliduj) - a.s., < r < tq. (6.3) 

Then F is A-superharmonic on Q in the sense of Relation (14. 3p . 
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Proof. From Remark 3, page 134 of [4j, we have 



Bu = uj]- F(uj) 



1 ^[F{B,,, 
-AF{u) = lim 

2 n-oo ]E[ri/„ \ Bo = uj 

which shows that AF < when (16.31) is satisfied. 



(6.4) 

□ 



This yields in particular the following class of A-superharmonic functionals. 
Proposition 6.2. Let the potential of F > be defined by 

r+oo 

G{uj) = / E[F{Bt) I Bo = uj]dt, K{d^) - (6-5) 
Jo 

assume that G G Dom (A) and that AG is continuous on Q. Then G is a A- 
superharmonic on Q. 



Proof. For all r > we have 



G(^) 



E 



FiBt)dt 



Bn =00 



> E[G(5.J I 5o = u;] 



which shows that G is A-superharmonic. 



□ 



Note that if F is bounded with bounded support in Q then G is bounded on Q, see 
e.g. Remark 3.5 of [7]. 



Convolution 

Positive superharmonic functionals can also be obtained by convolution, i.e. if F is 
A-superharmonic and G is positive and sufficiently integrable, then 

cu^ [ G{^)F{uj -u)F^{dCo) 
Jq 

is positive and A-superharmonic. 
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Cylindrical functionals 

Superharmonic functionals on Gaussian space can also be constructed as cylindri- 
cal functionals, by composition with finite-dimensional functions. Here we use the 
expansions of case (A). Prom the expression of A on cylindrical functionals 

n 
i=l 

we check that 

F = U{X^'X\h),...,X;,'X^{hn)) 

is superharmonic on ft if and only if /„ is superharmonic on R". Given a e IR and 
b e W, let fn,a,b : ^ M be defined as 

then fn,a,b is superharmonic on R", n > 3, if and only if a G [4 — 2n, 0]. Let 

Fn,a,b = fn,a,b {^i ^X"(/ii), . . . , A„^X"(/l„)) . 

We have 

DtlogFnab — 0. y o"^ ^5 

it\bi + x^'x-{h,)\' + ... + K + x-^x-{K)\'' 

and 

n 

= Y,d!VuZb{Xi'x-{h,),...,x-'x-{K)), 

i=l 

since (r/ife)fe>i is orthogonal in L^([0,T], dt), hence 

^V^n,a,b a{n-2 + a/2)/2 



^/F~b \hi + Ar'X«(/ii)f + . . . + |6„ + X-^X^{hn)f 
is negative if 4 — 2n < a < 0, which is minimal for a = 2 — n. We also have 
AF^,„,b ^ a(n + a-2) 
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which is negative for a G [2 — n, 0] and vanishes for a = 2 — n. In this case the 
estimator is given by 

Dt\ogFn.2-n,b = -{n - 2) } ^2 ^, 

tt \bi + Ar'X«(/ii)p + . . . + |6„ + A-iX«(/i„)| 
and from Proposition 15.21 inequahty (]5.2p actually also holds as an equality: 



with 



\X + D\ogFn^2-n,b - m||l2 



i[0,T],dt) 



R(cT, /i, m) - E„ 



I A logF^^S-n.fe^C^t 



(6.6) 



2 _ (n-2)2 

||-DlogF„2-n,b||L2{[0,T],dt) - r~r;777T|2 n , i / , m2- ^^'^^ 

Note that when u is deterministic, any superharmonic functional of the form 



can be replaced with 



U{Xi'x^{h,),...,x-'x-{K)), 



fn{X^'X{h),...,X-'X{K)) 



which retains the same harmonicity property, and can be directly computed from an 
observation of X. 



The Stein type estimator of u is given by 



with 



I.e. 



Xi + AlogF„,2-n,b, te[o,T], 



hi = X^ {u,hi), i = l,...,n, 



AlogF„,2-n,b = -{n-2) 



in "^112 

llL2([0,T],dt) 



where n„ denotes the orthogonal projection 

n n 

n„X(t) := Xl'X{hk)Thk{t) = J2 {bk + A, Thkit). 



k=l 



k=l 
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We have 



\DlogFn,2-n,b\\L^ 



([o,T]xn,p„ 



-4E„ 



•\/ Fn,2-n,b 



= (n-2)2E„ 
= (n-2)2E, 



|Ar'X(/ii)| +---+|A„iX(M 



ITT ITll"^ 
|iin^ llL2([0,T],dt) 



and 



|X + L>l0gF„,2-n,6-^i"' 



L2([o,r],dt) 



R((7, - (n-2)2E, 



In vii-2 

|iin^ llL2([0,r],(it) 



Note that the estimator 



Xt-{n-2)- 



TT YW"^ 



te [0,T], 



is of James-Stein type, but it is not a shrinkage operator. Another difference with 
James-Stein estimators is that here the denominator consists in a sum of squared 
Gaussians with different variances. 



Given (Xj^)tg[o,T], ■ ■ ■ , {X^)t&[o,T], N independent samples of {Xt)t^[Q;r\, the process 

x. = ]^(xl + -.. + x?) 

is a Brownian motion with drift u and quadratic variation a^dt/N under P^, and can 
be used for both efficient and Stein type estimation. 

7 Numerical application 

In this section we present numerical simulations which allow us to measure the effi- 
ciency of our estimators. We use the framework of case (A) and the superharmonic 
functionals constructed as cylindrical functionals in the previous section, and we as- 
sume that u & H is deterministic. 
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We work in the independent increment framework of Section [2] and we additionally 
assume that at = cr is constant, t G [0,T], i.e. {Xt)te[o,T] is a Brownian motion with 
variance cr^, Th(t) = a'^h{t), t G [0,T], and 



R{a,fx,u) = —T . 



Letting 



= -''1/2) ^"'(("4) y)- "^i- 

i.e. 

/i„(t) = ^yjcos(^(^n-0^^, tG[0,T], n>l, 

provides an orthonormal basis {hn)n>i of H such that (r/;,fc)fc>i is orthogonal in 
L2([0,T],dt), with 

aT 

An = ^ TTTTT, n > 1, 

7r(n — 1/2) 

solution of (16.11) . The estimator of u will be given by 

A log 2-n , = -(n-2) . /I V sin((k--)% 

For simulation purposes we will use X + D log F, and construct the (nondrifted) 
Brownian motion (X")tg[o,T] via the Paley- Wiener expansion 

n=l 71=1 \ 2 J 

where (r/„)„>i are independent standard Gaussian random variables with unit variance 
under Fu and 

7]n = ( K{s)dX:, n>l. 
Jo 

In this case we have 

Al0gF„,2-n,6 (7.2) 
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Recall that the improvement obtained in comparison with the efficient estimator u is 
not obtained pathwise, but in expectation. The gain of the superefficient estimator 
X + D log Fn,2-n,b Compared to the efficient estimator u is given by 

4 



G{u, a, T, n) 



R((T, /i, -u) " 



ri,b 



n,2—n,b 



as a function of n > 3. From (16. 6p and (17.21) we have 

G{u,a,T,n) = 2(n-2)2E 
hence G{u,a,T,n) converges to 



(7.3) 



. 1=1 



(7.4) 



as a tends to infinity. The quantity (17. 4p can be evaluated as a Gaussian integral to 
yield (11.21) . Unlike in the classical Stein method, we stress that here n becomes a free 
parameter and there is some interest in determining the values of n which yield the 
best performance. 

Proposition 7.1. For all (t,T > 0, and u (z H we have 

6 



G{u, 0", T, n) 



as n goes to infinity. 
Proof. Let 



= - ^ + (r/i + {u, hi))^ 



n> 1. 



Sn 



We have 

G{a,a,T,n) = 2(n-2)2E 

and by the strong law of large numbers, n{n — 2)^S'„^^ converges to 3/7r^ as n goes 
to infinity, since 

lim 



n— voo n' 



^ ^ = — im — y(2i - 1? = —. 



1=1 
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Now for all n > 10 we have 
(n-2)3N' 



Sn 



E 



Aiu) 



{n-2Y 

Sn 



3\ 2' 



< 





■ / [n/2] 


AS 




■ / [n/2] 


n2-iE[A(n)2]'/'E 




\fc=i 



/ 1 

n 2n 

-4-, 1/2 



-1/4 



1/2 



hence n^/Sn is uniformly integrable in > 16, where [n/2] denotes the integer part 
of n/2. This concludes the proof. □ 



In the sequel we choose Ut = at, t & [0,7"], a G M. Figure [711 gives a sample path 
representation of the process X + D logF. 



D log F 

X 

X + D log F .'■l\f/' 
drifj /'/ ' 




Figure 7.1: u{t) = t, t £ [0,T]; n = 5. 



In this case, from (17. 3p we have 
G{a,a,T,n) = 2{n-2Y'E 



r]i-a- (-1)' 

a 
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from which it follows that G{a, a, T, n) converges to 



v«=l 

when a^'^a'^/T tends to infinity, and is equivalent to 



1 - - 



a' 



n J a^T 

as Q~'^o'^lT tends to 0. Figure 17^ represents the gain in percentage of the super- 
efficient estimator X + o^D log -Fn,2-n,6 compared to the efficient estimator u using 
Monte-Carlo simulations, i.e. we represent 100 x a, T, n) as a function of n > 3. 

















Gai 
6/(n Pi'^2 


n 1 
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Figure 7.2: Percentage gain as a function of n for 10000 samples and a = a = T = \. 
An optimal value 

^opt = argmax 0", T, n) : ri > 3} 

of n exists in general and is equal to 4 when a = o = T = \. Figure 17.31 shows the 

variatiap-Tfif the eain as a function otraiand T ioY a,^ 1. r i 
V igure TT .41 represents xne variation of the gam as a function of n and a. 
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Percentage 






T 



Figure 7.3: Gain as a function of n and T. 




Figure 7.4: Gain clS cL function of n and a. 

8 Appendix 

The next Proposition is classical in the framework of Gaussian filtering and is needed 
in Section [2] for Bayes estimation. Its proof is stated for completeness since we did 
not find it in the literature. 

Proposition 8.1. Let Z be a Gaussian process with covariance operator Tr and drift 
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V G H , and assume that X is a Gaussian process with drift Z and quadratic covariance 
operator T given Z. Then, conditionally to X, Z has drift 

f ^ {Xu{^ + ^t)~^^v) + X{{T + Tr)~^Trf Xt) and covariance r^(r + r^)"^r. 
Proof. For convenience of notation, let 

y(/) = (/,(r + r,)-^r^), feH. 

For all f,g & H we have: 



E[exp(iX(/))] = E E exp(iX(/)) 
= E 



Z 



exp(zZ(/)--(/,r/) 



= exp{zV{f)--{f,{T, + T)f)], 



and 



E[exp(2X((7))exp {tZ{f))] 



E 

E 



exp(zZ(/))E exp{iX{g)) 



exp ( iZ{f + g) - -{g,Tg) 



exp ( -^(/ + g, Trif + g)) - \{g. Tg) + iV{f + g) 



= exp (^V{{V + r,)-ir,/) + iV{g + (F + F,)-iF/) - i(F,/, (F + F,)-iF/) 

+ (F + F,)-^F,/, (F + F,)(^ + (F + F,)-^F,/))^ 
= E[exp(^X((/)) 

exp {^X{{T + F^-'F,/) + iV{{T + F^-^F/) - i(F,/, (F, + F)-^F/)^ 



which shows that 



E 



X 



exp{iZ{f)) 

-- exp (^v{{r + Trr'rf) + ix{{r + f^-'f,/) - ^(f,/, (f + f^-'f/)^ . 



□ 
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In particular we get the following corollary which is classical in the framework of 
Gaussian filtering. 

Proposition 8.2. Let {Zt)te[o,T] be a Brownian motion with quadratic variation rfdt, 
T e L'^{[0,T],dt), and drift K)tg[o,T], v e H, and let {Xt)te[o,T] have drift {Zt)t(^[o,T] 
and quadratic variation (cj )te[o,T]; given Z. Then, conditionally to X, the process 
{Zt)te[o,T] has drift 

/ „ ^ ^ dvs + / „ " ^ dXs and variance / \ ds, te[0,r]. 

io t; + <^; Jo r; + (^s Jo Ts+<^i 
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